Structure from Motion Based Approaches to 3D Reconstruction in Minimal Invasive Laparoscopy
نویسندگان
چکیده
The present article proposes a Structure from Motion (SfM) methodology to recover the liver surface from endoscopic video sequences. Features from an imaged liver are extracted and tracked for the complete sequence to generate a correspondences lookup table (C-LUT) between all frames. A keyframe selection code extracts two frames, from which the relative pose of the camera is reconstructed using a MSAC-based 5-Point algorithm. Techniques such as an optimal triangulation method and a PnP resection algorithm are also used to obtain an initial 3D surface of the liver. A global Bundle Adjustment step refines the initial reconstruction. Proper parametrization and conditioning of these techniques are compared and evaluated under typical laparoscopic uncertainties arising from patient, illumination, reflections, image quality and organs’ location among others. A robotic system and grid patterns are used to provide camera pose and surface ground truth data respectively.
منابع مشابه
A robust motion estimation system for minimal invasive laparoscopy
Laparoscopy is a reliable imaging method to examine the liver. However, due to the limited field of view, a lot of experience is required from the surgeon to interpret the observed anatomy. Reconstruction of organ surfaces provide valuable additional information to the surgeon for a reliable diagnosis. Without an additional external tracking system the structure can be recovered from feature co...
متن کاملTarget detection Bridge Modelling using Point Cloud Segmentation Obtained from Photogrameric UAV
In recent years, great efforts have been made to generate 3D models of urban structures in photogrammetry and remote sensing. 3D reconstruction of the bridge, as one of the most important urban structures in transportation systems, has been neglected because of its geometric and structural complexity. Due to the UAV technology development in spatial data acquisition, in this study, the point cl...
متن کاملTissue Deformation Recovery with Gaussian Mixture Model Based Structure from Motion
Accurate 3D reconstruction of the surgical scene is important in intra-operative guidance. Existing methods are often based on the assumption that the camera is static or the tissue is deforming with periodic motion. In minimally invasive surgery, these assumptions do not always hold due to free-form tissue deformation induced by instrumenttissue interaction and camera motion required for conti...
متن کاملVideo-based 3D reconstruction, laparoscope localization and deformation recovery for abdominal minimally invasive surgery: a survey.
BACKGROUND The intra-operative three-dimensional (3D) structure of tissue organs and laparoscope motion are the basis for many tasks in computer-assisted surgery (CAS), such as safe surgical navigation and registration of pre-operative and intra-operative data for soft tissues. METHODS This article provides a literature review on laparoscopic video-based intra-operative techniques of 3D surfa...
متن کاملSparse reconstruction of liver cirrhosis from monocular mini-laparoscopic sequences
Mini-laparoscopy is a technique which is used by clinicians to inspect the liver surface with ultra-thin laparoscopes. However, so far no quantitative measures based on mini-laparoscopic sequences are possible. This paper presents a Structure from Motion (SfM) based methodology to do 3D reconstruction of liver cirrhosis from mini-laparoscopic videos. The approach combines state-of-the-art track...
متن کامل